Triangulating an exotic T quark 
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Limits on an exotic heavy quark T are broadly generalized by considering the full range of T — > 
Wb,th or tZ branching ratios. We combine results of specific T —¥ tZ and T —¥ Wb searches with 
limits on various combinations of decay modes evaluated by re-interpreting other searches. We find 
strong bounds across the entire space of branching ratios, ranging from hit > 415 GeV to hit > 557 
GeV at 95% confidence level. 

PACS numbers: 12.60,-i, 14.65.-Jk 



INTRODUCTION 



A fourth generation of fermions would be a natural 
extension to the standard model of particle physics. Di- 
rect searches for a chiral fourth-generation (b' and t'), 
however, have yielded no evidence for a fourth genera- 
tion of fermions. Specifically, the CMS collaboration has 
set limits of m t > > 557 GeV if BR(i' -> Wb)=W0% 
and m v > 611 GeV @ if BR(6' -> Wt)=100%. Even if 
these branching ratios are reduced by off-diagonal mix- 
ing terms, these analyses have complementary sensitivity 
which is nearly impossible to escape if the fourthgener- 
ation is chiral and decays via W-boson emission [3(. 

A fourth-generation quark, however, may be a vec- 
tor particle (T) which has exotic decays [1, such as 
T — > tZ or th, see Fig. [TJ Such a quark is a generic fea- 
ture [(| of models in which the Higgs boson is a composite 
state, such as models featuring a "little Higgs" The 
contribution from the T quark in such models is essen- 
tial to cancel the contributions to the Higgs mass from 
the top quark, keeping the Higgs mass at the electroweak 
scale. 

The LHC collaborations have strong sensitivity to such 
a quark [l(|. CMS performed a dedicated search for 
this T quark in data with 1 fb _1 , reporting mj- > 475 



GeV [11[ if BR(T -> tZ)=W0%, but no searches have 



been reported for the T — s- th mode, nor for models with 
realistic mixtures of decay modes, see Fig. [2j 

In previous work, we reinterpreted an ATLAS search 
for b' —> tW which has broad sensitivity for other 
heavy quark modes; we set limits on the T-quark mass 
in the case of a realistic mixture branching ratios, 
tot > 419 GeV [13 if BR(T ->• tZ)=15%, BR(T -> 
th)=35%, BR(T Wb)=50%. 

In this paper, we relax the assumptions which deter- 
mine the branching ratios as a function of mass and ex- 
plore the entire space of possible branching ratios, achiev- 
ing an important generalization of the existing limits. 
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FIG. 1: Decay modes of a heavy exotic quark, T 
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FIG. 2: Branching ratio of T-quark decays to Wb, tZ and th 
vs tut, from the model in Ref. 



DIRECT SEARCHES 

The CMS collaboration searched for a heavy chiral 
fourth-generation t' quark decaying via Wb in the di- 
lepton decay mode using data with 5.0 fb _1 of luminosity. 
We assume that this limit, to,t > 557 GeV at 95% CL, 
is also applicable to the exotic quark T when it decays 
to Wb. Other analyses have also been performed 13l4l5| , 
but we only consider the strongest limits. 

In addition, CMS searched directly for T-quark pro- 
duction specifically in the mode T — > tZ. Assuming 
BR(tZ) is 100%, their analysis yields m T > 475 GeV at 
95% CL from data with 1 fb _1 of integrated luminosity. 

The ATLAS collaboration reported a search for heavy 
fourth-generation down-type chiral quarks (6') using data 
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with 1 fb _1 [l6| of integrated luminosity. The b' de- 
cays via tW, leading to a final state with four W bosons 
and two b quarks. The single-lepton mode is used, leav- 
ing three hadronically decaying W bosons. The ATLAS 
search makes use of a novel technique for tagging boosted 
W bosons by searching for jet pairs with small angular 
separation. The analysis variables are the jet multiplic- 
ity and W boson multiplicity; it is a counting experiment 
in nine bins: N jet = (6, 7,>8)xJY ff = (0, 1, > 2). This 
analysis does not directly set limits on T-quark models, 
but it is clear that if such particles were produced, they 
would appear as an excess in this analysis. 

Note that the precise aim of the original b' — > tW anal- 
ysis is not directly relevant to the analysis presented in 
this paper, as we are reinterpretting it in another context. 
However, since the decay modes are similar (&' — > tW vs 
T — > tZ) in topology makes the reinterpretation more 
powerful and robust. 



REINTERPRETING b' -> tW 

Given the clear sensitivity of the ATLAS V search to T- 
quark production and decay, we reinterpret this analysis 
in the context of T-quark models. 

The ATLAS analysis uses a binned likelihood 
with nine bins in jet and JL-boson multiplicity: 
N jet = (6, 7,>8)x% = (0, 1, > 2). Until recently, 
reinterpretation of such a multi-bin analysis was effec- 
tively impossible, as it would require publication by the 
experiment of the complete likelihood details, including 
bin-to-bin correlations. However, we showed in recent 



work 12] that if the template for a new signal model can 
be expressed as a linear combination of the templates 
for models tested by the experiment, then limits on the 
new model can be trivially derived. This approach can 
be understood as an interpolation strategy, and is valid 
when the dominant systematic uncertainties are due to 
the background sources, or are similar between the basis 
templates and the new signal model. 

We exploit this approach to derive limits on T-quark 
production and decay in a variety of decay modes. We 
generate T production and decay using MADGRAPH [jjj ]. 
use pythia 12311 to model showering and hadronization, 
and use PGS [17( to describe the detector response. In 
every case, we use m/j = 125 GeV. 

In the following sections, we find mixtures of the 
b 1 — > tW templates which closely approximate templates 
for exotic T quark decays in tZ, th, (tZ and th), (Wb and 
th), sor (Wb,th, and tZ) decay modes. In each case, we 
find the approximations to be imperfect but reasonable. 
Variations of the template mixtures which have discrep- 
ancies of similar magnitude but opposite sign give similar 
results to those we present, suggesting that the results are 
not highly sensitive to these discrepancies. Uncertainties 
due to the imperfect description are assessed. 
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FIG. 3: Jet and IL-boson multiplicity, for T — >• tZ events 
(solid blue). Also shown (dashed red) is the sum of b' basis 
templates used to derive the limit on the T quark model. Left 
for rriT — 450 GeV, right for mr = 550 GeV. 



TABLE I: Details of the predicted limit on T pair-production 
and T —¥ tZ decay, using basis templates from b' — > tW 
decays at ATLAS. 
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Decays to tZ 

If the T-quark decays exclusively to iZ, then the final 
state of ttZZ closely resembles the ttWW final state of 
the b' search, as the jet resolution does not allow us to 
distinguish between W — ¥ qq' and Z — >■ qq decays, and 
the mass window used (70— 100 GeV) encompasses most 
hadronic Z-boson decays. 

The templates for T — >• tZ are shown in Fig. [3] as well 
as the linear combination of b' templates used as a set of 
basis templates. Table U gives the details of the decom- 
position and Fig.|4]shows the derived upper limits on the 
cross-section. If BR(T —5- tZ)=10Q%, the reinterpreta- 
tion of the V search yields mj > 446 GeV at 95% CL, 
comparable to the CMS limit of m*r > 475 GeV derived 
from a search optimized for this mode. 



Decays to th 

Decays of the T-quark to th would give a tihh final 
state. If iriH = 125 GeV, the predominant Higgs boson 
decay mode is bb. As in the case of tZ decays, this gives 
a final state similar to that used in the b' search, though 
the larger Higgs mass gives a smaller number of observed 
W-boson tags due to the 70 — 100 GeV mass window, 
and a somewhat larger jet multiplicity. 
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TABLE II: Details of the predicted limit on T pair- 
production and T — > tH decay, using basis templates from 
b' -> Wt decays at ATLAS. 
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FIG. 4: Upper limits at 95% CL on the cross-section for 
T-quark pair production in the tZ decay mode. 




FIG. 5: Jet and W-boson multiplicity, for T —¥ th events 
(solid blue). Also shown (dashed red) is the sum of b' basis 
templates used to derive the limit on the T quark model. Left 
for m T = 450 GeV, right for m T = 550 GeV. 
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FIG. 6: Upper limits at 95% CL on the cross-section for 
T-quark pair production in the th decay mode. 



The templates for T — > th decay are shown in Fig. [5] 
It was not possible to find a linear combination of b' 
basis templates which accurately reproduce the th tem- 
plates unless we remove th events with more than eight 
jets. This reduces the sensitivity, as the overall yield is 
decreased, and thus produces a somewhat conservative 
limit. 

Table [IT] gives the details of the decomposition and 
Fig.[B]shows the derived upper limits on the cross-section. 
If BR(T -> th)=W0%, the reinterpretation of the b' 
search yields > 423 GeV at 95% CL, the first limit 
in this mode. 



Decays to tZ and th 

To probe a mixed case, we allow both tZ and th de- 
cays, which gives tiZZ, tihh modes as well as the mixed 
mode ttZh. The relative tZ : th branching ratios are 
unchanged, see Fig. [5] 

The templates for T — > th,tZ decay are shown in 
Fig. [7J Table IIIII gives the details of the decomposition 
and Fig. [S] shows the derived upper limits on the cross- 



section. If BK(th or tZ)=100%, the reinterpretation of 
the b' search yields tot > 419 GeV at 95% CL, the first 
limit in this mixed mode. 

Decays with Wb 

We probe two more mixed-decay cases which include 
Wb decays. The first allows either Wb or th decays; see 



TABLE III: Details of the predicted limit on T pair- 
production and T — > tZ, tH decays, using basis templates 
from b' -> Wt decays at ATLAS. 
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FIG. 7: Jet and VF-boson multiplicity, for T —¥ tZ, th events 
(solid blue). Also shown (dashed red) is the sum of b' basis 
templates used to derive the limit on the T quark model. Left 
for rriT = 450 GeV, right for mr = 550 GeV. 



FIG. 9: Jet and W-boson multiplicity, for T —¥ Wb, th events 
(solid blue). Also shown (dashed red) is the sum of b' basis 
templates used to derive the limit on the T quark model. Left 
for mr = 450 GeV, right for mr = 550 GeV. 
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FIG. 8: Upper limits at 95% CL on the cross-section for 
T-quark pair production in the tZ, tH decay mode. 



TABLE IV: Details of the predicted limit on T pair- 
production and T — > tH, Wb decays, using basis templates 
from 6' -> Wt decays at ATLAS. 
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LIMITS IN THE BRANCHING RATIO 
TRIANGLE 



Fig. |U for templates, Table HVl for decomposition details 
and Fig. [TU] for limits. If BR(t/i or Wb)=100%, the rein- 
terpretation of the b 1 search yields m-r > 415 GeV at 
95% CL, the first limit in this mixed mode. 



Each of the results above place lower limits on the 
mass of the T quark under specific assumptions about 
the branching ratios. Table IVll summarizes these results. 
For each scenario, we quote the branching ratios at the 
limit value. Figure [13] shows the results graphically, with 
interpolated values. 



The second case allows all three decays (Wb, th or tZ) 
in the predicted mixture (Fig. [2]) ; see Fig. QT] for tem- 
plates, Table fVl for decomposition details and Fig. [T^l for 
limits. If BR(th or tZ or VF6)=100%, the reinterpreta- 
tion of the b' search yields tot > 419 GeV at 95% CL as 
reported previously 



12 



In both cases, the T-quark signal has a jet multiplicity 
which is quite different from the b 1 — > Wt basis templates. 
The most accurate description of T-quark templates uses 
the low-mass and high-mass b 1 basis templates (see Ta- 
bles IIVI and [Vj which have the least overlap and so can 
be varied nearly independently to achieve the desired jet 
multiplicity of the T-quark signals with Wb decays. 



TABLE V: Details of the predicted limit on T pair- 
production and tZ, tH, Wb decays, using basis templates from 
b' -> tW decays at ATLAS. 
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FIG. 10: Upper limits at 95% CL on the cross-section for 
T-quark pair production in the th, Wb decay mode. 



FIG. 12: Upper limits at 95% CL on the cross-section for 
T-quark pair production in the th, tZ, Wb decay mode. 
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FIG. 11: Jet and VF-boson multiplicity, for T -> Wb,th,tZ 
events (solid blue). Also shown (dashed red) is the sum of 
b' basis templates used to derive the limit on the T quark 
model. Left for mr = 450 GeV, right for tut = 550 GeV. 
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CONCLUSIONS 

Searches for an exotic heavy quark T have been pre- 
viously reported for specific choices of the decay modes: 
BR(W6)=100% or BR(tZ)=100%. We consider alter- 
native branching ratio scenarios, scanning the branching 
ratio triangle. We derive limits for these scenarios by 
reinterpretting a recent ATLAS search for b' . 

We find limits for T at mr > 415 GeV across the 
entire triangle, up to itlt > 557 GeV in the case of Wb 
decay. An optimized experimental search for decays with 
large th branching ratio would lead to significantly tighter 
limits across the triangle. 
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FIG. 13: Lower limits at 95% CL on the mass (GeV) of 
the exotic T quark for varying assumptions about branch- 
ing ratios. Black squares show the points at which the 
limits are calculated; contours are interpolated. Limits at 
BR(lFb)=100% 0| and BR(tZ)=100% [ll[ are taken from 
dedicated searches; other points our reinterpretations (see Ta- 
ble IVll). 



TABLE VI: Summary of mass limits at 95% CL for various 
branching ratios. For BR(tZ) = 100%, we include for compar- 
ison the direct limit from CMS [111] as well as our reinter- 
pretation of the ATLAS [l(J b' Wt search for this case. 
Uncertainties are due to imperfect description of the signal 
model via the basis templates. 
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